18504-AAD158.4_Fall2013 11/6/13 12:44 PM Page 453 


4 ^ 


Stinson, M. S., & Stevenson, S. (2013). Effects of expanded and standard captions on deaf college students’ 
comprehension of educational videos. American Annals of the Deaf, 158(4), xxx-xxx. 

Effects of Expanded and Standard Captions 
on Deaf College Students’ Comprehension 
of Educational Videos 



Michael S. Stinson and 
Susan Stevenson 


Both authors are affiliated with the, 
National Technical Institute for the Deaf, 
Rochester Institute of Technology, 
Rochester, NY. Stinson is a professor, 
Master of Science in Secondary 
Education Department; Stevenson is a 

RESEARCH ASSISTANT IN THE DEPARTMENT. 


wenty-two college students who were deaf viewed one instruc¬ 
tional video with standard captions and a second with expanded cap¬ 
tions, in which key terms were expanded in the form of vocabulary 
definitions, labeled illustrations, or concept maps. The students performed 
better on a posttest after viewing either type of caption than on a pretest; 
however, there was no difference in comprehension between standard and 
expanded captions. Camtasia recording software enabled examination of 
the extent to which the students accessed the expanded captions. The 
students accessed less than 20% of the available expanded captions. 
Thus, one explanation for the lack of difference in comprehension 
between the standard and expanded captions is that the students did not 
access the expanded captions sufficiently. Despite limited use of the 
expanded captions, the students stated, when interviewed, that they con¬ 
sidered these captions beneficial in learning from the instructional video. 
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As mandated by law, virtually all televi¬ 
sion programs may now be viewed with 
captions. These captions are a text dis¬ 
play of the audio component of the tel¬ 
evision program, which is generally 
displayed at the bottom of the televi¬ 
sion screen (Lewis & Jackson, 2001). 
Captions may be open, where everyone 
viewing the video sees the captions, or 
closed, where the viewer must set the 
closed-captioned decoder, which is 
contained in virtually all television sets, 
so that it displays captions. A major rea¬ 


son for the production of captions is to 
provide deaf people access to the audio 
component of television programming. 
(The term deaf is used in the present 
article to refer to the full range of indi¬ 
viduals with hearing loss, including 
members of the Deaf culture.) Produc¬ 
ers of captions and educators have both 
been concerned whether individuals 
who are deaf are able to understand 
captions that are presented at rela¬ 
tively fast speeds (e.g., greater than 140 
words per minute) and that sometimes 
contain complex grammatical forms. 
This concern is based on the limited 
reading proficiency of many persons 
who are deaf (Ward, Wang, Paul, & 
Loeterman, 2007). 
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A number of investigators have 
examined ways to modify captions to 
improve deaf individuals’ comprehen¬ 
sion of videos. Some research on the 
effects of captions on comprehension 
has focused on whether the captions 
have been edited to delete informa¬ 
tion viewed as nonessential and to sim¬ 
plify grammatical structure (Baker, 
1985; Braverman & Hertzog, 1980). 
Other research has examined the 
speed at which captions are presented, 
and the association between reading 
proficiency and comprehension (Burn¬ 
ham et al., 2008). Studies on the effects 
of editing captions to reduce linguistic 
complexity have obtained mixed re¬ 
sults. Braverman and Hertzog (1980) 
found, with college students, and 
Baker (1985), with deaf children, that 
reducing language complexity in¬ 
creased comprehension of a television 
program. In the Baker study, the edit¬ 
ing of captions was accompanied by a 
reduction in the caption presentation 
rate so that it was not clear whether 
rate or language complexity was the 
primary factor that accounted for the 
results. In contrast, Ward et al. (2007) 
did not find with children, and Burn¬ 
ham et al. (2008) did not find with 
adults, that reducing linguistic com¬ 
plexity increased (or decreased) com¬ 
prehension of captions. 

Two studies examined effects of 
caption rate on comprehension. These 
studies indicated that rate either has 
no effect on comprehension or that 
variation in rate only affects selected 
readers. Braverman and Hertzog (1980) 
found that rates of 60, 90, and 120 
words per minute did not differen¬ 
tially affect comprehension by students. 
Burnham et al. (2008), in contrast, 
found that rates of 130, 180, and 230 
words per minute selectively affected 
participants’ comprehension, depend¬ 
ing on the reading proficiency of the 
participants. Slower caption rates 
tended to facilitate the comprehension 


of more proficient readers, but this 
was not the case for less proficient 
readers. 

Another factor that may increase 
deaf students’ comprehension of cap¬ 
tions is expansion of the amount of 
information available in the captions. 
Fels (2002) and Silverman and Fels 
(2002) suggested that nonverbal in¬ 
formation, including shapes, colors, 
symbols, and animation, increases deaf 
individuals’ comprehension when used 
with captions. For example, use of 
speech bubbles and different text 
styles may help captions convey the 
emotions of different speakers. In 
addition, captions may be made inter¬ 
active through use of hyperlinks to 
provide optional definitions, back¬ 
ground information, related material, 
or an instructional exercise (Trevi- 
ranus, 2000). 

Anderson-Inman, Terrazas-Arellanes, 
and Slabin (2009) investigated whether 
use of expanded captions increased 
comprehension of captioned educa¬ 
tional videos with biology content by 
nine deaf students in grades 6-12. 
Expanded captions might deepen the 
value of educational videos by linking 
important words that are likely to be 
unfamiliar in the captions to one of 
three kinds of additional information: 
vocabulary definitions, labeled illustra¬ 
tions, or concept maps. Anderson- 
Inman et al. (2009) described each of 
these types of information in the 
expanded captions as a form of eText 
support; eText is digital text that is 
modified to facilitate the reader’s 
comprehension or learning of a text 
(Anderson-Inman, 2009). 

Anderson-Inman et al. (2009) com¬ 
pared gains in learning from a pretest 
to a posttest when students viewed a 
video with expanded captions in which 
they could access additional informa¬ 
tion and when they viewed a video 
with standard captions. Tests for statis¬ 
tical significance indicated that stu¬ 


dents did not retain more information 
when viewing expanded captions than 
when viewing standard captions. Fur¬ 
thermore, students did not perform 
better on posttests than on pretests for 
either condition. 

One reason that Anderson-Inman et 
al. (2009) did not find differences 
between performance on the pre- and 
posttests for either the expanded or 
standard captions may have been that 
the students did not have a sufficiently 
high reading level (a) to benefit from 
these captioned materials in general, 
and (b) to benefit more from the 
expanded captions than from the stan¬ 
dard ones. Previous research had 
found that deaf students who are more 
proficient readers benefit more from 
captions than students who are less 
proficient readers (Burnham et al., 
2008; Lewis &Jackson, 2001). 

The present investigation followed 
up on the Anderson-Inman et al. 
(2009) investigation by using the same 
materials used by Anderson-Inman et 
al. with deaf college students in order 
to determine whether these students, 
who have more academic experience 
and higher reading proficiency, would 
benefit from the captions. This investi¬ 
gation addressed three questions: 

1. Do deaf college students learn 
from viewing a captioned in¬ 
structional video , as indicated 
by a pretest-to-posttest increase 
in performance? This question 
pertained to student gains in test 
performance regardless of 
whether the captions were stan¬ 
dard or expanded. 

2. Do student learn more when 
they view expanded captions 
than when they view standard 
ones, as indicated by a greater 
pretest-to-posttest increase in 
performance for the expanded 
captions than for the standard 
ones? 
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3. How did students perceive their 
experiences with the standard 
and expanded captions? The 
study included qualitative inter¬ 
views to identify students’ per¬ 
ceptions of what was desirable 
and undesirable in each kind of 
caption, information that might 
help with interpretation of the 
quantitative results as well as 
yield suggestions for improving 
the expanded captions. 

Method 

Design 

All participants underwent each of the 
experiment’s two treatment condi¬ 
tions: (a) standard captions and (b) 
expanded captions (Shadish, Cook, & 
Campbell, 2002). For standard cap¬ 
tions, there were two videos with dif¬ 
ferent content, and each of these had 
a corresponding video for expanded 
captions. Students were randomly 
assigned to a combination that coun¬ 
terbalanced video content, treatment, 
and presentation order across partici¬ 
pating students. This counterbalanc¬ 
ing controlled for confounding of 
treatment with video content and 
associated tests and with order of 
presentation. 

Participants 

Twenty-two volunteers attending a 
university in the northeastern United 
States participated in the present study. 
Participants were recruited through fly¬ 
ers posted throughout the campus 
asking for students who were deaf 
or hard of hearing. The study had 
received approval of the university’s 
institutional review board, and stu¬ 
dents completed a letter of consent 
prior to participation. Table 1 provides 
demographic information about the 
students; pseudonyms were used to 
protect confidentiality. Twelve of the 
students were female and 10 were 
male. Students’ level of hearing loss 


ranged from profound in both ears (n 
= 11) to mild in both ears (n = 1). 
The mean ACT English score was 16.13 
(percentile equivalent = 25%, Ameri¬ 
can College Testing, 2011), and the 
mean ACT Reading score was 19.88 
(percentile equivalent = 47%). These 
data indicate that these students were 
relatively proficient readers compared 
to the general population of deaf read¬ 
ers. The mean reading percentile score 
of 47 for the deaf students in this study 
was close to the midpoint in the ACT 
norms, which are based on hearing 
students. In contrast, the mean read¬ 
ing comprehension score in a nation¬ 
wide survey of deaf students at grade 
levels 10-12 was substantially lower 
(slightly above the 18th percentile in 
the National Longitudinal Transition 
Study on the Woodcock-Johnson Tests 
of Academic Achievement, norms from 
hearing students; Wagner, Newman, 
Cameto, & Levine, 2006; Walter, 2010; 
Woodcock, McGrew, & Mather, 2001). 

Students ranged in age from 17 to 
26 years, with a mean age of 21.45. 
Data were available for 11 participants 
regarding their use of amplification. 
Four used a cochlear implant, 3 used 
two hearing aids, 2 used one hearing 
aid, and 2 did not use amplification. 
With respect to ethnicity, of the 20 stu¬ 
dents for whom data were available, 
2 were African American, 1 was Asian, 
1 was Hispanic, and 16 were White. 
For some students, certain data were 
not available (NA). This information 
was drawn from student records at the 
university. 

Intervention 

The present study used expanded cap¬ 
tions in which preselected vocabulary 
words were linked to one of three 
types of additional information: glos¬ 
sary definitions, labeled illustrations, 
and concept maps. In addition, ex¬ 
panded captions provided a way for 
learners to interact with, and study, the 


video’s content. The three types of 
expanded captions represented three 
different ways in which key vocabulary 
was supported to improve compre¬ 
hension. “Translational resources” were 
key vocabulary words in captions linked 
to definitions for “translating” unfamil¬ 
iar words into a word or words that 
were more familiar to the learner 
(Anderson-Inman & Horney, 2007). 
Translations included synonyms for 
identified words, and longer defini¬ 
tions that explained their technical 
meaning. “Illustrative resources” were 
key vocabulary words linked to labeled 
illustrations (Anderson-Inman & Hor¬ 
ney, 2007). Illustrative resources pro¬ 
vided visual images of concepts or 
processes. For these types of expanded 
captions, the video stopped and the 
resulting image in a separate window 
was labeled, by means of arrows, 
directing attention to the concept or 
process linked with the vocabulary 
word. “Summarizing resources” were 
key vocabulary words linked to con¬ 
cept maps (Anderson-Inman & Hor¬ 
ney, 2007). Summarizing resources 
provided an overview of some aspect 
of the content under instruction—in 
this case, the taxonomic system used 
to describe the biological structure of 
life. When accessing a window with the 
additional information, the student 
could not view the display of the orig¬ 
inal educational video and accompa¬ 
nying captions; the student clicked on 
the Back button (or pressed Enter) to 
return to the original display of video 
and captions. 

Materials 

Videos and Captions 

Three 20-minute educational videos 
from the series Branches on the Tree 
of Life (www.ebiomedia.com/vmchk/ 
Branches-on-the-Tree-of-Life), by Bio- 
MEDIA Associates, were used in the 
research for the present study, one for 
training and two for the experimental 
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Table 1 

Student Characteristics 


Student a 

Gender 

Hearing loss, 

left ear 

Hearing loss, 
right ear 

ACT Reading score 

ACT English score 

Age (years) 

Abiel 

F 

Profound 

Severe 

NA 

NA 

20 

Breanna 

F 

Profound 

Profound 

13 

15 

24 

Abigail 

F 

Severe 

Profound 

21 

21 

22 

Ryan 

M 

Profound 

Profound 

21 

17 

19 

Stephanie 

F 

NA 

NA 

36 

29 

19 

Erika 

F 

Profound 

Profound 

19 

9 

18 

Jamie 

F 

Profound 

Severe 

15 

11 

24 

Andrew 

M 

Profound 

Profound 

NA 

NA 

26 

Mona 

F 

Profound 

Profound 

20 

19 

18 

Keith 

M 

Profound 

Profound 

0 

0 

24 

Brian 

M 

Profound 

Profound 

0 

0 

22 

Blake 

F 

Profound 

Profound 

19 

13 

20 

Breanna 

F 

Severe 

Severe 

26 

23 

20 

Tom 

M 

Profound 

Profound 

18 

14 

19 

Patrick 

M 

NA 

NA 

22 

15 

23 

William 

M 

Moderate 

Moderate-severe 

21 

17 

19 

Nathaniel 

M 

Profound 

Profound 

23 

16 

22 

Sean 

M 

Mild 

Mild 

NA 

NA 

24 

Caitlin 

F 

Profound 

Profound 

13 

10 

25 

Brittany 

F 

NA 

NA 

NA 

NA 

17 

Kiera 

F 

NA 

NA 

13 

18 

24 

James 

M 

Profound 

Severe 

18 

11 

23 

a Pseudonyms were used to protect confidentiality. 


treatments. These materials already 
had standard captions, developed by 
CaptionMax, a large media access com¬ 
pany in the United States. CaptionMax 
selected the specific videos from the 
Branches series using the following 
criteria: (a) 15-20 minutes in length, 
(b) content independent of other 
videos, and (c) content not generally 
known by average secondary students. 
To create expanded captions, Ander- 
son-Inman et al. (2009) identified key 
terms in these videos that might be 
problematic for students and decided 
how best to support learning of the 
concept. This process led to the three 
types of expanded captions described 
above. Each of these three is described 
below and illustrated in Figure 1. 

Vocabulary definitions were the 
most common type of expanded cap¬ 


tion. Key content words in the cap¬ 
tions were highlighted in green. When 
students clicked on the highlighted 
word (or pressed Enter), a new win¬ 
dow appeared. The window repeated 
the target word, followed by a defini¬ 
tion tied to the word’s use in the video. 
Clicking the Back button (or pressing 
Enter again) returned viewers to the 
video segment with the original cap¬ 
tioned sentence still on the screen. 
The video then continued playing until 
the student clicked on another high¬ 
lighted word to access the additional 
information for that word. 

Labeled illustrations directed atten¬ 
tion to specific features illustrated in 
the videos. When students clicked on 
the highlighted word, the image froze, 
and text with arrows drew attention to 
the target concept. Pressing Enter re¬ 


turned viewers to the video with the 
original captioned sentence. 

Concept maps depicted the rela¬ 
tionship of targeted organisms within 
biology’s hierarchy of eight major tax¬ 
onomic ranks: species, genus, family, 
order, class, phylum, kingdom, and 
domain. These relationships were an 
important conceptual element in the 
Branches of the Tree of Life video 
series. When understanding one of 
these distinctions seemed to be the 
focus of the video, a concept map in 
the expanded caption showed the 
organism on a “tree” in relationship to 
other concepts of the same or neigh¬ 
boring taxonomic level. When students 
clicked on the highlighted word, a new 
window appeared containing a con¬ 
cept map that zoomed in on the tar¬ 
geted organism and then zoomed out. 
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Figure 1 

Screen Shots Illustrating Annotated Captions (on the left) and the Corresponding Three Types of Expanded Captions (on the right) 



Example: annotated caption Example: definition 



Example: annotated caption 


Example: concept map 


Note. From “Supported eText in Captioned Videos: A Comparison of Expanded Versus Standard Captions on Student Comprehension of Educational Content,” 
by L. Anderson-lnman, F. E.Terrazas-Arellanes, and U. Slabin, 2009, Journal of Special Education Technology, 24(3), pp. 25-26. Copyright 2009 by Exceptional 
Innovations. Adapted with permission. 


457 


Volume 158, No. 4, 2013 


American Annals of the Deaf 






















18504-AAD158.4 Fall2013 11/6/13 12:44 PM Page 458 


Effects of Expanded and Standard Captions 


Clicking the Back button (or pressing 
Enter again) returned students to 
the video with the original captioned 
sentence. 

The difference between the videos 
with standard captions and the ones 
with expanded captions is that in 
those with standard captions, none of 
the words were highlighted and there 
were no separate windows with addi¬ 
tional information. In contrast, the 
videos with the expanded captions (a) 
had highlighted words among the cap¬ 
tions for the educational video and 
enabled users to click on these words, 
and (b) required users to access the 
additional information in a separate 
window (e.g., vocabulary definitions). 

Instrumentation 

Information on student use of the 
videos and its impact on comprehen¬ 
sion was measured in three ways: (a) 
pre- and posttests on important con¬ 
cepts in the videos, (b) screen-capture 
recordings of students’ interactions 
with the videos, and (c) an exit inter¬ 
view on students’ reactions to the 
expanded captions. The present study 
used the same three sets of pre- and 
posttests (one set for each video) used 
by Anderson-Inman et al. (2009) to 
measure students’ comprehension of 
the vocabulary and informational con¬ 
tent of the videos. Each test consisted 
of 10 multiple-choice questions, and 
each question had three response 
alternatives. Each set of pre- and post¬ 
tests had the same items, with the 
items ordered differently in the two 
versions by random assignment. In 
addition, response alternatives for 
each question were in a different order 
for each version. These are examples 
of pre-and posttest items from the 
tests for a video on flatworms: 

Pretest: These flatworms live in the 

bladder and lungs of animals: (a) 

Amphibians (b) Embryos (c) Flukes. 


Posttest: One of the surviving 
branches of flatworms is called: (a) 
Cestoda (b) Jellyfish (c) Snakes. 

These are examples of pre- and 
posttest items from the tests for a video 
on algae: 

Pretest-. What do the different types of 
algae have in common? (a) Prokary¬ 
otic cells and silica (b) Eukaryotic 
cells and plastids (c) Oblong shape. 

Posttest: One example of an oblong 
diatom is: (a) Pinnate (b) Tadpoles (c) 
Centric. 

The posttests for the algae and flat- 
worm videos are in Appendix A. Inter¬ 
item reliability results (coefficient 
alpha) with the participant sample 
were .05 and .14 for the algae pre- and 
posttests, respectively. Test means 
were 4.54 (SD = 1.53) and 6.09 (SD = 
1.60), respectively. Interitem reliability 
was .63 and .67 for the flatworm pre- 
and posttests, respectively. Means 
were 4.81 (SD = 2.36) and 6.77 (SD = 
2.30), respectively. 

Screen-capture recordings were 
made with the Camtasia software 
application (TechSmith, Inc.), which 
was installed on the desktop computer 
the students used for the present 
study. The application started simulta¬ 
neously with the playback of a video, 
recording the entire screen and all stu¬ 
dent interactions with the video’s con¬ 
tents. After students finished viewing a 
video, the researcher conducting the 
session would save the Camtasia re¬ 
cording for data analysis. The record¬ 
ings showed which expanded captions 
were accessed, as well as other inter¬ 
actions with the DVD (e.g., pause, 
fast-forward, and back-forward). This 
information documented whether stu¬ 
dents used the expanded captions, 
and the frequency of their use. 

A researcher conducted open-ended 


interviews to obtain participants’ pref¬ 
erences and experiences with ex¬ 
panded and standard captions, as well 
as suggestions for improving the cap¬ 
tions. Students responded to the fol¬ 
lowing questions: 

• How much experience have you 
had using captions to learn from 
educational videos? 

• What do you like best about hav¬ 
ing captions available to you on 
educational videos? 

• In this study, we provided a dif¬ 
ferent type of caption: captions 
that allowed you to click on 
some of the words to get more 
information. Was this type of cap¬ 
tion helpful to you? If yes, why? If 
no, why not? 

• If you had your choice of cap¬ 
tions, would you like: the stan¬ 
dard captions, the ones you are 
used to having; or the new cap¬ 
tions, the ones where you can 
click on words to get more infor¬ 
mation? Explain why. 

• If you were designing captions 
for students who are deaf or 
hard of hearing, what would they 
look like and what would they be 
able to do? 

The researcher administering the inter¬ 
view video audio-recorded the stu¬ 
dents’ signed and/or spoken responses. 
Soon after interviewing each student, 
she transcribed these responses. Once 
all interviews had been transcribed, she 
and another researcher read the tran¬ 
scripts and developed a set of coding 
categories. Interview comments were 
then assigned to categories, and re-read 
to identify major themes that were sup¬ 
ported through quotations from partic¬ 
ipants (Bogdan & Biklen, 2007). 

Procedures 

A researcher administered the proce¬ 
dures to one student at a time in single 
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sessions of approximately 1.5 hours 
each. Each session had four parts: (a) 
training, (b) experimental video 1, (c) 
experimental video 2, and (d) an exit 
interview. The researcher who admin¬ 
istered these procedures, a teacher of 
the deaf, used sign communication 
with or without voice, depending on 
the participant’s preference. 

Training 

The training consisted of five steps. 
First, the researcher provided back¬ 
ground information about the study 
and its purpose. Second, she ex¬ 
plained the standard captions and 
demonstrated their use, and students 
then practiced using these captions 
for a few minutes with the standard- 
captions version of the video from the 
Branches of Life series on the Cnidar- 
ians, a phylum of invertebrates such 
as jellyfish. Third, she explained the 
expanded captions and demonstrated 
their use. This demonstration in¬ 
cluded instruction in using each of 
the three types of expanded captions. 
Students practiced using the ex¬ 
panded captions with the expanded- 
captions version of the Cnidarians 
video for approximately 5 minutes. 
Fourth, students completed five ques¬ 
tions on a paper copy of the posttest 
for the Cnidarians video. Students 
were told (a) that this was a practice 
test, so that they would be familiar 
with the tests they would take on the 
other videos, and (b) that it was not a 
timed test. Fifth, students could ask 
questions about the two experimental 
conditions or the procedures. 

Experimental Videos 

Students viewed one video with stan¬ 
dard captions in one content area and 
a second video with expanded cap¬ 
tions in a second content area. Stu¬ 
dents were randomly assigned to one 
of four counterbalanced video con¬ 
tent/treatment combinations: 


1. the algae video with standard 
captions followed by the flat- 
worms video with expanded 
captions 

2. the algae video with expanded 
captions followed by the flat- 
worms video with standard 
captions 

3. the flatworms video with standard 
captions followed by the algae 
video with expanded captions 

4. the flatworms video with ex¬ 
panded captions followed by 
the algae video with standard 
captions 

This counterbalancing of video con¬ 
tent/treatment combinations con¬ 
trolled for confounding of treatment 
with video content (and associated 
tests) and order. So that we could con¬ 
trol for video content, half of the par¬ 
ticipants viewed one of the videos with 
expanded captions, and half of the par¬ 
ticipants viewed the same video with 
standard captions. The first half of the 
participants viewed the second video 
with standard captions, and the other 
half viewed the second video with 
expanded captions. Order was con¬ 
trolled for by having half of the partic¬ 
ipants view a video with expanded 
captions first, and the other half view a 
video with expanded captions second. 
The first half of the participants viewed 
a video with standard captions second, 
and the other half viewed a video with 
standard captions first. 

For the first experimental video, 
students completed the pretest on the 
vocabulary and informational content; 
next, they watched the assigned video, 
then they completed the posttest. For 
example, students in video content/ 
treatment combination (a) completed 
the pretest for the algae video, watched 
the algae video with standard captions, 
then completed the posttest for the 
algae video. The procedure for the sec¬ 
ond experimental video was similar to 


that for the first. For example, students 
in video content/treatment combina¬ 
tion (a) completed the flatworms 
pretest, watched the flatworms video 
with expanded captions, then com¬ 
pleted the flatworms posttest. During 
the viewing of experimental videos 
with expanded captions, Camtasia was 
used to capture a screen-based video 
of each student’s experience with 
these captions. After completion of 
both experimental videos, students 
responded to the brief student exit 
survey, speaking and/or signing their 
answers. 

Results 

Performance on Content 
Tests as a Function of 
Captions and Test 

The first set of analyses addressed the 
questions of (a) whether students per¬ 
formed better on a posttest after view¬ 
ing the captions than on a pretest; and 
(b) whether students showed a greater 
gain in their score from pretest to 
posttest score in the expanded-caption 
condition than in the standard-caption 
condition. These analyses examined 
effects of two factors on performance 
on the content knowledge test: (a) 
captions (two levels: standard and 
expanded, a within-subjects factor) 
and (b) test (two levels: pre- and 
posttest, also a within-subjects factor). 
Table 2 presents the mean pre- and 
posttest scores for standard and 
expanded captions. A repeated-meas¬ 
ures ANOVA was performed on the 
dependent variable of number of items 
correct on a test. The partial eta 
squared statistic (iq p 2 ) is reported for 
each main or interaction effect to pro¬ 
vide an estimate of the effect size. This 
statistic indicates the amount of vari¬ 
ance in the dependent variable (s) 
attributable to the particular effect of 
interest (Heiman, 2000). 

The analyses revealed that there 
was a significant effect for test, F( 1, 21) 
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Table 2 

Mean Pre- and Posttest Scores for Standard and Expanded Captions 




Pretest 



Posttest 


Captions 

M 

SD 

Range 

M 

SD 

Range 

Standard 

4.27 

1.75 

2-7 

6.36 

1.86 

2-10 

Expanded 

5.09 

2.14 

2-10 

6.50 

2.15 

2-9 


= 31.18, p < .001, y] p 2 = .60. This 
result indicated that the mean score 
for the posttests (M = 6.43, SD =2.01) 
was higher than that for the pretests 
(M = 4.68, SD = 1.94). 

There was not a statistically signifi¬ 
cant effect for captions, F( 1, 21) = 
1.35,/? > • 20, T| p 2 = .06 (standard cap¬ 
tions, M = 5-31, SD = 1.81; expanded 
captions, M = 5.79, SD = 2.14). The 
Captions x Test interaction effect also 
was not statistically significant, F(l, 21) 
= 1.22 ,p > . 20, T| p 2 = .06. This lack of 
an interaction effect indicated that 
there was not a significant difference 
between the pre-to-posttest improve¬ 
ment under expanded captions and 
under standard ones. 

One additional analysis examined 
each student’s change in score from 
pretest to posttest. For standard cap¬ 
tions, 16 of the 22 students increased 
their score, with 14 of these 16 increas¬ 
ing their score by 2 or more points; 4 
students decreased their score, all by 
1 point, and 2 did not change their 
score. For expanded captions, 15 of 
22 increased their score, 12 by 2 or 
more points; 5 decreased their score, 
3 by 2 or more points; and 3 did not 
change their score. Thus, there was a 
strong tendency toward improvement 
of scores. 

Because the reliabilities of the algae 
video pre- and posttests were low, a 
second additional analysis was con¬ 
ducted to determine whether these 
differences in scale reliability related 
to results for each set of tests. This 
analysis separately examined for the 
algae and the flatworm pair of tests the 
effects of captions (two levels; stan¬ 


dard and expanded, a between-sub- 
jects factor) and test (two levels: pre- 
and posttest, a within-subjects factor). 
Results for each of these pairs of tests 
were virtually identical. For both the 
algae and flatworm pairs, scores were 
higher on the posttest than on the 
pretest, with each difference statisti¬ 
cally significant at p < .001. Further¬ 
more, for each pair of tests there was 
not a statistically significant difference 
between means for the standard and 
expanded-caption conditions, and 
there was not a significant Captions x 
Test interaction effect, with p > .20 for 
each of these tests. These results were 
also virtually identical to those for the 
initial analysis that used both the algae 
and flatworm pairs of tests. 

Extent of Student Access 
to Expanded Captions 

The video recordings of students’ 
interactions with the computer pro¬ 
duced with the Camtasia software 
while viewing the flatworms and algae 
instructional videos with expanded 
captions were analyzed to determine 
(a) the extent to which students ac¬ 
cessed the expanded captions and (b) 
whether the extent that students ac¬ 
cessed these captions changed from 
the first to second halves. This analysis 
computed the amount, by percentage, 
that students accessed expanded cap¬ 
tions for the first half of the video, for 
the second half, and for the whole 
video. (As noted, viewing of the videos 
with standard and expanded captions 
was counterbalanced across partici¬ 
pants; therefore, each participant 
viewed one of the two expanded cap¬ 


tion videos.) Table 3 presents the mean 
percentage of expanded captions that 
students accessed for each half and for 
the entire instructional video. 

As shown in Table 3, students ac¬ 
cessed only some of the additional 
information in expanded captions, less 
than 20% on average. Furthermore, for 
both videos, students accessed more 
additional information while watching 
the first halves of these videos than 
while watching the second halves. 
Paired t tests that compared the mean 
percentage of expanded captions that 
students accessed for the two halves 
indicated that for the flatworms video, 
students accessed significantly more 
expanded captions in the first half than 
in the second,/(ll) = 8.42 ,p < .0001; 
for the algae video, the difference was 
not statistically significant. 

Exit Interviews 

Students commented on the impor¬ 
tance of captions in educational videos, 
indicated their preference for either 
standard or expanded captions, and 
suggested improvements in the design 
of captions. Students felt that captions 
on educational videos helped them 
understand what was happening and 
what was being said. Every participant 
who was interviewed made a positive 
comment about the benefits of cap¬ 
tions. Some participants commented 
that captions were essential for under¬ 
standing educational videos. One stu¬ 
dent said, “Without closed captions, I 
wouldn’t understand anything that is 
happening.” 

Most students commented that see¬ 
ing the spelling of complex terms in 
the captions helped them remember 
the terms. Several felt that captions 
were more helpful than interpreters 
for understanding educational videos. 

Most students said they preferred 
the expanded captions to the standard 
ones. Students preferred these cap¬ 
tions because when they clicked on a 
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Table 3 

Mean Percentage of Expanded Captions Students Accessed for Each Half and for 
the Whole Instructional Video 


Video and part 

n 

M 

SD 

Range 

Flatworm 

Part 1 

12 

.24 

.12 

.08-45 

Part 2 


.09 

.12 

.00-.36 

Total 


.16 

.12 

.04-.39 

Algae 

10 




Part 1 


.17 

.09 

.08-36 

Part 2 


.10 

.11 

.00-.36 

Total 


.13 

.07 

.04-.26 


highlighted word in these captions, a 
window opened that immediately pro¬ 
vided a definition of the captioned 
word in print, diagram, or picture for¬ 
mat. This feature meant that students 
obtained an immediate explanation of 
the word; they did not need to write 
down the unknown word and then 
wait until they had access to a diction¬ 
ary to learn the definition. As one stu¬ 
dent put it, 

The closed captions, with the extra 
titles and vocabulary, really helped me 
more. Because when watching in class 
with the standard captions I have to 
take notes on the words I don’t know 
and I have to go home and study and 
make sure I understand. 

In addition, students commented pos¬ 
itively on the expanded captions’ inclu¬ 
sion of pictures and diagrams because 
these materials supported visual learn¬ 
ing and because the highlighting of 
captioned words signaled that a par¬ 
ticular word was an important one to 
learn. Also, some students stated that 
they benefited from the opportunity 
to stop the video and view the ex¬ 
panded caption because doing this 
process required taking more time to 
process the information than if they 
did not have this opportunity. 

Seven of the 22 students did not 
view the expanded captions as help¬ 


ful. Reasons for preferring the stan¬ 
dard captions were that accessing and 
viewing expanded captions inter¬ 
rupted the flow of information and 
consequently disrupted learning; pro¬ 
cessing the additional information in 
the expanded captions required too 
much time; the information in the 
expanded captions was already familiar 
to most viewers and was therefore 
unnecessary; and standard captions 
were more comfortable to use because 
they were more familiar. In regard to 
this last point, one student stated, “I 
would take the old-fashioned one 
because I am 27 years old and I know 
a lot. So at this point, if I needed to 
look something up I would just go on 
the Internet anyway.” 

In providing ideas for designing bet¬ 
ter captions, a number of students 
made suggestions for forms of caption¬ 
ing that were similar to the expanded 
captions in the present study. That is, 
videos would highlight captions for 
key words and students would be able 
to access definitions, pictures, and dia¬ 
grams for these words. Students also 
suggested different ideas for better 
captions, grouped here into four cate¬ 
gories. First, some students suggested 
that videos include more highlighted, 
expandable captions. Second, students 
suggested modifications in the pace of 
presentation of the captions and picto¬ 
rial information in videos. One sugges¬ 


tion was to increase the spacing 
between highlighted words in the cap¬ 
tions because when one highlighted 
word was immediately followed by 
a second one, the short interval 
between the two words sometimes 
resulted in students being unprepared 
to access the second highlighted word. 
Another idea was to modify the pace of 
presentation of the pictorial infor¬ 
mation and the captioning because 
students sometimes had difficulty 
simultaneously attending to and com¬ 
prehending both parts of the video. 

A third set of ideas involved chang¬ 
ing the display so that students could 
more effectively relate the information 
in the segment with the original mate¬ 
rial in one window to the additional 
information that was in a different win¬ 
dow. One suggestion was for the video 
to display the original information in a 
single window, with the highlighted 
caption in the background, when show¬ 
ing the additional information, rather 
than have the original video and cap¬ 
tion and the additional information in 
two separate windows. A fourth set of 
ideas concerned providing more exten¬ 
sive information in the expanded cap¬ 
tions. Expanded captions could include 
more charts, illustrations, examples, 
diagrams, signs, symbols, and pictures 
of the item being defined. 

Discussion 

The present study examined the effects 
of standard and expanded captions on 
deaf college students’ comprehension 
of educational videos with biology con¬ 
tent. The study found that students 
performed better, at a statistically sig¬ 
nificant level, on the posttest of com¬ 
prehension than on the pretest for 
both the standard and expanded cap¬ 
tions. However, results that compared 
pre-to-posttest gains in performance 
revealed that the extent of improve¬ 
ment under expanded captions was 
not different, at a level of statistical sig- 
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nificance, from that under standard 
captions. Contrary to expectations, 
students did not appear to compre¬ 
hend more of the video content when 
they had the opportunity to access 
vocabulary definitions, labeled illustra¬ 
tions, or concept maps while watching 
the separate window with the ex¬ 
panded captions. 

Use of Camtasia recording software 
made it possible to examine the extent 
to which students accessed expanded 
captions. It is disappointing that stu¬ 
dents accessed the additional informa¬ 
tion in few expanded captions, less 
than 20% of the available captions, and 
the proportion that they accessed 
declined noticeably from the first half 
of the video to the second half. In spite 
of quite limited use of the expanded 
captions, students stated that they 
considered these captions beneficial 
in the interview that followed the 
videos and tests. Most students stated 
that they preferred expanded captions 
to standard ones, with the main reason 
being that the definitions of the high¬ 
lighted words, which they often did 
not know, were immediately accessi¬ 
ble in the expanded captions. 

The discrepancy found in the pres¬ 
ent study between the students’ per¬ 
ception of the expanded captions as 
helpful and their apparent failure to 
learn more with these captions may 
not be all that unusual in comparisons 
of student perceptions of an accom¬ 
modation and their actual learning. For 
example, in one study (Elliot, Stinson, 
McKee, Everhart, & Francis, 2001), 
deaf college students self-reported 
that a real-time display of captions was 
beneficial, but in a second study, which 
included an experimental assessment 
of retention of lecture information 
(Stinson, Elliot, Kelly, & Liu, 2009), deaf 
college students did not retain more 
information with captions than with 
traditional (i.e., interpreting) services. 

The preference for expanded cap¬ 


tions may have been related to affec¬ 
tive factors, such as students believing 
that these captions were helpful. Affec¬ 
tive factors are important because they 
are associated with comprehension in 
reading and other academic activities 
(Taboada, Tonks, Wigfield, & Guthrie, 
2009). This affective factor is a reason 
why it may be desirable to include 
expanded captions in educational 
videos. If students receive an accom¬ 
modation they perceive as helping 
them perform better on a task, this may 
increase motivation and improve com¬ 
prehension (Feldman, Kim, & Elliot, 
2011 ). 

Except for the finding of overall 
improvement in performance from 
pretest to posttest (i.e., for both stan¬ 
dard and expanded captions), the 
results of the present study, with deaf 
college students, were generally simi¬ 
lar to those of the Anderson-Inman et 
al. (2009) study, with deaf middle and 
high school students. Whereas the col¬ 
lege students did significantly better 
on the posttest than on the pretest, 
the middle and high school students 
did not do significantly better on the 
posttest. The overall pre-to-posttest 
mean gain (1.75) was larger for the 
present study with college students 
than it was for the study with middle 
and high school students (0.96); the 
sample size for the college study was 
also larger (22 vs. 9). Both factors likely 
contributed to this difference between 
the results for these two studies. 

One explanation for the greater 
improvement by the college students 
is that they were more proficient read¬ 
ers and users of English and had more 
academic studying and test-taking 
experience than the younger students. 
This interpretation is supported by 
previous research that found that 
more proficient readers are better at 
comprehending captioned videos 
(Burnham et al., 2008; Lewis & Jack- 
son, 2001). The higher proficiency and 


greater experience of the college stu¬ 
dents may have been particularly 
important to their comprehension of 
the captioned materials because these 
materials seemed to be fairly difficult, 
based on relatively low mean posttest 
scores. The inclusion of numerous sci¬ 
entific terms that students needed to 
learn and the technical nature of the 
materials contributed to their difficulty 
level (Anderson-Inman et al., 2009). 

In the present study and Anderson- 
Inman et al. (2009), pre-to-posttest 
gains in performance with the ex¬ 
panded and standard captions were 
not different from each other at a sta¬ 
tistically significant level. In fact, there 
was a greater gain for the standard cap¬ 
tions than for the expanded ones. (The 
difference was not statistically signifi¬ 
cant; it is possible, however, that if the 
sample size had been several times 
larger, the difference would have been 
statistically significant.) Also, in both 
studies, the participants accessed a 
relatively small percentage of the 
expanded captions, with the propor¬ 
tion of captions they accessed declin¬ 
ing from the first to the second part of 
the video. The limited access to ex¬ 
panded captions provides an explana¬ 
tion of why participants did not benefit 
from them: Participants did not access 
enough of these captions. Students 
will not learn the scientific terms in the 
expanded captions if they do not ac¬ 
cess them. 

Students may have been unaware 
that they did not know terms that they 
could have accessed, limited by fea¬ 
tures of the technology (e.g., length of 
time that words were highlighted), 
tired of accessing the captions, and/ 
or desirous of hurrying through the 
experimental session. The suggestion 
that deaf students thought they knew 
highlighted terms in the expanded 
captions, and were unaware that they 
did not really know these terms, is 
consistent with research on metacog- 
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nition of deaf students that indicates 
that these students often fail to use 
metacognitive strategies, such as being 
aware of what one does not know 
(Hauser, Lukomski, & Hillman, 2008; 
Marschark, Sapere, Convertino, & See- 
wagen, 2005). 

In addition, usable hearing may 
have reduced the extent to which 
some students accessed the expanded 
captions. There were several students 
with mild hearing loss and/or a 
cochlear implant who may not have 
needed the captions to understand the 
video, or, alternately, used the captions 
to supplement the audio. These stu¬ 
dents may have infrequently accessed 
the expanded captions because these 
segments had no sound and the stu¬ 
dents may have preferred to hear the 
audio when watching the video. It is 
not clear, however, to what extent 
these students were able to benefit 
from the sound because the standard 
videos did not show the speaker’s face, 
so the students could not use speech¬ 
reading to help them understand the 
audio. 

Certain features of the video tech¬ 
nology may have limited the extent to 
which students could access and learn 
from the expanded captions. Students’ 
comments in the interviews suggested 
that these features may have included 
a pace of presentation of the pictorial 
and captioned information that was 
too fast for them to process the infor¬ 
mation, consider whether they knew 
the highlighted word, then access it in 
a separate window. In addition, short 
time periods between highlighted 
words in the video may have resulted 
in students not being ready to access 
the additional information for a subse¬ 
quent highlighted word if they had 
accessed the information for the previ¬ 
ous highlighted word. Students also 
may have had difficulty relating the 
additional information that was in one 
window to the original video with the 


highlighted caption in the other win¬ 
dow. At least some of these difficulties 
may have been due to students’ lack of 
practice with using the expanded cap¬ 
tions. Although students did receive 
training in using the expanded cap¬ 
tions and did practice using them for 
several minutes prior to viewing them 
in the experimental session, it is likely 
that they would have become more 
proficient if they had had more prac¬ 
tice with them. 

In addition, students may have 
accessed the additional information in 
only a few expanded captions because 
there was insufficient incentive for 
them to carefully study the material. 
Since participants were volunteers and 
performance in the experiment was 
not tied to any course, the only incen¬ 
tive for the students to do well was a 
desire to do so for its own sake. 

Generalization of the present study’s 
findings to other deaf students is lim¬ 
ited by the small sample size of 22 par¬ 
ticipants, the participants’ relatively 
high level of reading proficiency, and 
their hearing levels. As noted, it is pos¬ 
sible that a substantially larger sample 
might have demonstrated a statistically 
significant difference between gains in 
test performance in favor of standard 
captions. The participants’ reading pro¬ 
ficiency was substantially higher than 
that of the typical deaf high school 
graduate (Walter, 2010). This study’s 
participants were probably more simi¬ 
lar to other deaf students who attend 4- 
year postsecondary programs, who are 
presumably more proficient readers, 
than to students who attend 2-year pro¬ 
grams or who are in secondary school 
programs. With respect to hearing level, 
7 participants had hearing levels in the 
better ear in the mild to severe range, 
and 4 used a cochlear implant. Partici¬ 
pants with different hearing levels 
might have accessed the videos and 
performed on the tests differently than 
this study’s participants. 


A limitation of the present study 
was the low reliability of the algae 
video pre- and posttests. It is not clear 
how this low test reliability affected the 
results. In the analyses for effects of 
test and captions that were conducted 
separately with the algae and flatworm 
sets of tests, test reliability did not 
appear to be related to results of the 
tests of statistical significance. It is pos¬ 
sible that the difference in reliability 
related to variability in test perform¬ 
ance. The average standard deviation 
for the flatworm tests was .77 larger 
than that for the algae tests. 

Because the reliability of the algae 
pre- and posttests was low, the present 
study should be replicated with more 
reliable measures. Factors that may 
have contributed to the low reliability 
of the algae tests include unfamiliarity 
of the content, difficulty of items, lim¬ 
itations in students’ proficiency in 
reading English, and use of an out-of- 
class experiment in which some stu¬ 
dents devoted limited attention to 
questionnaire items (McCrae, Kurtz, 
Yamagata, & Terracciano, 2011). It is 
also desirable for future research to be 
conducted as part of actual classes 
because researchers perhaps would 
better prepare the students to com¬ 
plete the tests and use the videos, and 
students might pay greater attention 
to these materials. 

Recommendations for 
Future Research 

Since neither the present study with 
college students or the Anderson- 
Inman et al. (2009) study with middle 
and high school student has shown 
that expanded captions increase com¬ 
prehension, when the same set of 
materials and similar procedures are 
used, it is clear that future work on 
expanded captions needs to include 
modification of the materials and pro¬ 
cedures. One modification would be 
to make more explicit to the students 
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what they do and do not know in the 
material they are learning. For exam¬ 
ple, students could be given a study 
guide with questions about the con¬ 
tent that they were responsible for 
learning in the video. This suggestion 
is based on research that interspersing 
questions throughout the text substan¬ 
tially increases students’ learning of 
educational media content (Dowaliby 
& Lang, 1999; Lang & Steely, 2003). 

In conclusion, although the ex¬ 
panded caption technology has yet to 
demonstrate its efficacy, it still seems 
promising because it addresses two 
key challenges deaf students often face 
in learning: First, the opportunity for 
more thorough review of material can 
help deaf students deal with language 
processing issues that these students 
often face; second, the opportunity for 
students to obtain definitions, illustra¬ 
tions, concepts maps, or other infor¬ 
mation can help them overcome 
challenges that result from limited 
content knowledge (Marschark, Con- 
vertino, McEvoy, & Masteller, 2004; 
Marschark et al., 2005). Given this 
potential, it is important for future 
research to find ways of using the DVD 
freeze-frame capability included in the 
present study that have a demonstra¬ 
ble impact on the learning of deaf stu¬ 
dents (Anderson-Inman et al., 2009). 
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Effects of Expanded and Standard Captions 

Appendix A 

Posttests for the Algae and Flatworm Videos 


Algae 

Directions: Circle the letter next to the correct response. 

1. Select the one that is an example of golden-brown algae. 

a) Euglena 

b) Shellfish 

c) Sea palms 

2. One example of an oblong diatom is: 

a) Pinnate 

b) Tadpoles 

c) Centric 

3. These female sex cells will produce Spirogyra algae. 

a) Zygotes 

b) Plankton 

c) Sperm 

4. Diatoms extract this crystal from surrounding water. 

a) Pigments 

b) Salt 

c) Silica 

5. Algae make and store food in their: 

a) Stomach 

b) Plastids 

c) Nuclei 

6. Which single-cell algae can be seen floating in water? 

a) Diatoms 

b) Plants 

c) Dinoflagellates 

7. Euglenids are a type of_found in water. 

a) Compound 

b) Red algae 

c) Green algae 

8. What do the different types of algae have in common? 

a) Eukaryotic cells and plastids 

b) Oblong shape 

c) Prokaryotic cells and silica 

9. The small animal that feeds on dinoflagellates (making it dangerous to humans) is called: 

a) Larvae 

b) Mollusk 

c) Ant 

10. These organisms are not plants or bacteria. 

a) Roses 

b) Algae 

c) Streptococci 
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Flatworms 

Directions: Circle the letter next to the correct response. 

1. These flatworms live in the bladder and lungs of animals. 

a) Amphibians 

b) Embryos 

c) Flukes 

2. One of the surviving branches of flatworms is called: 

a) Cestoda 

b) Jellyfish 

c) Snakes 

3. Human beings function as hosts for a flatworm called: 

a) Flukes 

b) Earthworm 

c) Taenia solium 

4. What happens when human beings eat tapeworm eggs? 

a) The eggs are digested. 

b) The eggs are regurgitated. 

c) The eggs turn into worms that kill. 

5. What do large flatworms eat? 

a) Algae 

b) Insects 

c) Crustaceans 

6. On what surfaces do ectoparasites live? 

a) Rocks 

b) Water 

c) Fish and amphibians 

7. Flatworms are organisms that have the following form. 

a) Triangular 

b) Bilaterally symmetrical 

c) Radially symmetrical 

8. These flatworms are able to avoid bright sunlight. 

a) Planarian 

b) Monogenea 

c) Tapeworm 

9. The segments of a tapeworm that have both male and female sex organs are called: 

a) Mammalia 

b) Proglottids 

c) Scolex 

10. Larvae that live on snail tissue develop into sacs called: 

a) Tendon cells 

b) G cells 

c) Germinal cells 
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